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Abstract 

We generalize Brudno’s theorem of 1-dimensional shift dynamical 
system to (or subshifts. That is to say, in (or sub¬ 
shift, the Kolmogorov-Sinai entropy is equivalent to the Kolmogorov 
complexity density almost everywhere for an ergodic shift-invariant 
measure. 
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1 Introduction 

In a topological dynamical system, A. A. Brudno defined a complexity of 
the trajectory of a point in the space by using the notion of Kolmogorov 
complexity, and showed the relationship between this quantity and the 
Kolmogorov-Sinai entropy [2]. As a preliminary step, Brudno considered 
the 1-dimensional shift dynamical system and showed that, for an ergodic 
shift-invariant measure, the Kolmogorov complexity density is equal to the 
Kolmogorov-Sinai entropy almost everywhere [21 Theorem 1.1]. 
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A partial approach to generalize this theorem to a d-dimensional case is 
found in [7]. S. G. Simpson showed that, in (or Z‘^) subshifts, there exists 
a point such that its Kolmogorov complexity density is coincident with the 
topological entropy [7]. Examining Simpson’s proof, we see that what he 
showed substantively is that the Kolmogorov complexity density is equal 
to the Kolmogorov-Sinai entropy almost everywhere only for a measure of 
maximal entropy. 

The purpose of this paper is to generalize the Brudno’s theorem of the 
Z^-action shift dynamical system to Z'’* (or Z‘^) subshifts. The main theorem 
is the following: 

Theorem 3.1 (Brudno’s theorem for Z'^ (or subshifts) If/j, € EM{S,(^), 
then 

dC(a;) = fi-a.e.u! € S. (3.1) 


Here S denotes Z'’* (or Z^) subshift, ? denotes the shift action on S, 
EM{S, <j) denotes the set of all ergodic shift-invariant measures on the topo¬ 
logical dynamical system (S',?), %{u) denotes the Kolmogorov complexity 
density of to, and /i^(/i) denotes the Kolmogorov-Sinai entropy of the measure 
preserving dynamical system (S, iB(S), /r, ?). We give the rigorous definition 
of these terms in Section 2. 

In Section 2, we introduce some basic mathematical notions in ergodic 
theory, Kolmogorov complexity and shift dynamical systems. We used [3j 
and [3] as main references for this section. Using these basic notions, we 
define the Kolmogorov complexity density of each point of (or S^+) 
naturally. 

In Section 3, we prove the main theorem. The proof directly uses an 
idea of Brudno’s original paper, i.e., Shannon-McMillan-Breimann theorem 
and the notion of frequency set. 

In the last section, as an application of the main theorem, we show a 
variational principle using the Kolmogorov complexity density. 

2 Some Mathematical Preliminaries 

We first give quick reviews for some mathematical results related to the 
main theorem. Descriptions of this section are restricted to a minimum and 
all the contents in this section are well known. We write 

N = {1,2,--.}, Z = {... ,-2,-l,0,l,2,--.}, Z+ = {0,1,2,--.}. 
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For an arbitrary fixed d G N, we set G := or G := For all n G N, let 
An := {g = {9i)f=i G G : Vi G {I,-- - ,d},\gi\ < n}. 


Then we have 


|A„ 



l)d (G = Z'^), 
{G = Zi), 


where we denote by |yl| the cardinality of a set A. 


2.1 Ergodic theory 

2.1.1 Measure preserving dynamical system 

First, let us define Kolmogorov-Sinai entropy, also known as measure-theoretic 
entropy. 


Definition 2.1 (Measure preserving dynamical system) Let {X,^, fx) 
be a probability space and 7 = {T^)g^G be a family of maps on X sueh that 

(1) fi is 7-invariant, i.e., Mg G G,\/A G fi{T~^A) = p{A) (where 
T-9 := {T9)-^); 

(2) 7 is a measurable action ofG on X, i.e., : X ^ X is measurable for 

all g € G, = Ix (the identity map on X) and Vg,g' G G,T9~^9' = 
T9 o T9' (if G = Z<^, then {T9)-^ = Ts holds). 

We call such a quadruple {X,^, p,7) a measure preserving dynamieal sys¬ 
tem (m.p.d.s.). 

Definition 2.2 Let {X,^, p,7) be a m.p.d.s.. A ^-measurable funetion f 
on X is said to be 7-invariant mod g if and only if\/gGG,foT9 = f 
(p-a.s.). A set A £ ^ is said to be 7-invariant mod g if and only if 1 a 
is 7-invariant mod g, where we denote the charaeteristic funetion of A by 
1a- We write 3^(7) := {A £ ^ : A is 7-invariant mod g} = {A £ ^ -.Vg £ 
G, g{T~9A A A) = 0}, where A denotes the symmetric difference. 


Theorem 2.3 (BirkhofF’s ergodic theorem) Let {X,^, g,7) be a m.p.d.s.. 

Then, for all f £ L^{X,g), there exists the limit 


fix) 


lim 

n^oo 





g-a.s. X, 
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and f € L^{X,fx). Moreover, f is 7-invariant mod /i and 




L 


fdn 


L 




Proof. See [3]. 


□ 


Definition 2.4 (Ergodicity) Let (X, 5S,/i,T) be a m.p.d.s. If for all f G 


L 


f 


fdpL, fJL-a.s. X 


holds, then the m.p.d.s. {X,^, fi,7) is said to be ergodic. In this case, p, 
is called an ergodic 7-invariant probability measure on the measurable space 




Although there are several equivalent conditions of ergodicity, only the 
above-mentioned condition is used in this paper. 

Definition 2.5 (//-partition) Let{X,^,p) be a probability space. A fam¬ 
ily of measurable sets a = {Ai : i G /} C 55 is called a p-partition of X if 
the following conditions hold: 



p{Ai n Aj) = 0 (/ / j), // ( X \ [J Aj j =0 and p{Ai) >0 (Vi G /). 


Accordingly, a is at most countable. If |/| < oo is holds, then a is called a 
finite p-partition. 

Let a and fi be //-partitions of X. The common refinement of a and fi 


a V /3 := {A n i? : A G a, i? G /3, //(A fl i?) > 0} 


is a //-partition of X. 

Definition 2.6 (Information and entropy of a //-partion) Let (X, 53,//) 
he a probability space, and a be a p-partition of X. The information of a is 
the measurable function la on X defined by 


Ia{x) log 2 p{A) • 1a(x), X G X. 


A&a 
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The entropy of a is defined by the average information, i.e. 


H{a) := I^ I{a)dn = 

A£a 


lx 


where we define the function cp : [0, cx)) -A W by 

<p{t) : = 


-tlogat (i > 0), 
0 (i = 0). 


From Kolmogorov complexity’s point of view, we choose the binary log¬ 
arithm log 2 instead of logg. 


Definition 2.7 (Dynamical entropy relative to a partition) Let (X, *B,/r, T) 

be a m.p.d.s. and a be a fi-partition of X. We set T~^a := {T~3A : A £ a} 
for each g £ G and := ® finite subset A C G. The dy¬ 

namical entropy of the m.p.d.s. (X, T) relative to the partition a is 
defined by 

h{n,a,7) := ini 

n>0 |A„| 

Theorem 2.8 Let p,7) be a m.p.d.s. and a be a pi-partition of X. 

Then 

h{ix,a,7) = lim —— 

n-foo |Aji| 


Proof See [3]. 


□ 


Theorem 2.9 (Shannon-McMillan-Breiman) Let (X, 53,/x, T) be an er- 
godic m.p.d.s. and a be a ^.-partition of X with H{a) < oo. Then 


h{pL, a, 7) 


lim 

n—>-oo 



in L^(X, pi). 


Moreover, if a is finite, then this convergence holds also for p,-a.s. 


Proof. See [3l[5]. □ 

Definition 2.10 (Kolmogorov-Sinai entropy) The Kolmogorov-Sinai en¬ 
tropy (KS entropy) of the m.p.d.s (X, 5S,/U,T) is defined by 

hj{p) := sup{/i(^, a, T) : a is a p-partition with H{a) < oo}. 
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Definition 2.11 (//-generator) Let {X,^, fi,7) be a m.p.d.s.. A ^.-partition 
a is called a pL-generator if = 53 mod fi, where this equation means that 
VA G 53, 35 € a^,pi{A AB) = 0. 

Theorem 2.12 (Kolmogorov-Sinai) Let (X,53,/i,T) be a m.p.d.s. and 

a be a p-generator such that H{a) < oo. Then h<j{p) = h{p,a,7). 

Proof. See [3]. □ 

2.1.2 Topological dynamical system 

We give the definition of topological dynamical system and its entropy via 
a variational principle of KS entropy. 

Definition 2.13 (Topological dynamical system) The pair {X, 7) is called 
a topological dynamical system (t.d.s.) if the following conditions hold: 

(1) X is a compact metrizable space; 

(2) T = {T^)g^G is a continuous action of G on X, i.e., for all g & G, 

T^ : X ^ X is continuous. 

In this setting we denote by 53(X) the Borel a-algebra of X. By (2), 7 is a 
measurable action of G on X. 

Let (W,T) be a t.d.s.. We denote by M{X) the set of all probability 
measures on the Borel measurable space (W, 53(W)), by M{X,7) the set of 
all “J-invariant probability measures on {X, 53(W)) and by EM{X, T) the set 
of all ergodic members in M{X,7), respectively. 

Theorem 2.14 (Krylov-Bogolubov) If X ^ and (W,T) is a t.d.s., 

then M(W,T) / 0. 

Proof. See [3]. □ 

Obviously, if // € M{X,7) then (W, 53(W),//, T) is a m.p.d.s.. We define 
a concept of topological entropy of a t.d.s. (W, T) as follows. 

Definition 2.15 (upper semicontinuous function) Let Y be a topolog¬ 
ical space. We set 

USG{Y) := {f : Y ^ [—c», oo) : Vc G M, {?/ G T : f{y) < c} is open} , 

and an element of USG{Y) is called an upper semicontinuous function on 

Y. 
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Definition 2.16 (Pressure, topological entropy, equilibrium state) 

Let (X, T) he a t.d.s. and let V’ G USC{X), inf ■0 > —oo. The pressure of 
^|J is defined by 

p{fi) := sup + Ki’)) 

neM{x,7) 

where p-ifi) := f^'ip{x)dp{x). A measure v G M{X,7) is called an equilib¬ 
rium state for ip £ USC{X) if 

pifi) = hjfu) + 

In particular, p(0) = sup^^jif(^x,r) ^7 (t) *5 called the topological entropy of 
{X,7), and the equilibrium state for tp = 0 is called a measure of maximal 
entropy for T. 

Theorem 2.17 (Ergodic decomposition) Let (X,T) be a t.d.s.. Then, 
for each p £ M{X,7), there uniquely exists a measure p on the space 
M{X,7) (with respect to the Borel a-algebra associated to the weak-* topol¬ 
ogy) such that 

(1) for any bounded measurable function f : X we have 

[ f{x)dp{x)= [ \[ f{x)diy{x)\dp{n). 

Jx JeM(X,7) Ux J 

(2) p{EM{X,7)) = l. 

Proof. See [HI El [8]. □ 

Since p{A) = j^j^^^j.^v{A)dp{u) for a measurable set A £ iB(X), we 
write p = fEM{X 7 ) ^dp{v) which is called the ergodic decomposition of p. 

Theorem 2.18 (Jacobs’s theorem) Let{X,7) beat.d.s.. If p £ M{X,7) 
and p = O') ^dp{v) is the ergodic decomposition of p, then we have 

h 7 {p) = / h‘y{n)dp{v). 

JeM{X,7) 


Proof. See [HIH]. 


□ 
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2.2 Kolmogorov complexity 

Let yi be a nonempty finite set. Without loss of generality, we set >1 ;= 
{0,1, • • • ,N} where N G Z+. 

We dehne the set of all finite strings over A as follows. 

C30 

A* := IJ = {A, 0,1, • • • , iV, 00, 01, • • • , OiV, 10, • • • , liV, • • • , NN, 000, • • • } 

n=0 


where = {A} and A denote the empty string. 

We often identify yi* with Z_|_ or Z by using the bijective map 
yl* tt (tt £ defined by the following. 


Ia*-,z{x) 


'n—1 n 

^ + 1)^ + ^ ak{N + l)'^-^ X = aiaa • • • a„ G yi'^ (n G N), 

k=0 k=l 

.0, x = A, 

a {Ia*^i.+ {x)) 


where a{n) := (—1)"'+^[^^J for all n G Z+. 

For example, the case of yi = {0,1} is as follows: 


X 

X 

0 

1 

00 

01 

10 

11 

000 

001 • • • 

I{0A}*^'L+{x) 

0 

1 

2 

3 

4 

5 

6 

7 

8 

X 

A 

0 

1 

00 

01 

10 

11 

000 

001 • • • 


0 

1 

-1 

2 

-2 

3 

-3 

4 

_4 ... 


For convenience, we define 

The map A* A* 3 {x,y) ^ xy ^ A* is called the concatenation. The 
set yi* with the concatenation is a monoid with identity element A, i.e., 
{xy)z = x{yz) for all x,y,z G yi* and Xx = xX = x for all x G yi*. 

The length of x G yi* is denoted by l{x) which is defined by ^(x) = n ^ 
X G yi”. Obviously, we have for all x,y G A*,l{xy) = l{x) + l{y). 

For all X, y G yi*, we call x a prefix of y if there exists z ^ A* such that 
y = xz. A set ^ C A* is said to be prefix-free if, for all x G A, the elements 
of A \ {x} is not a prefix of x. We set for all x G A* 



l{x) 


then we have fix) = 2fix) + 1. 



Let Ai,A 2 be a nonempty finite set. Let 2? be a subset of A^ and let / 
be a function from D to A^- If D C yi*, we call such a function / a partial 
function and write / : yi* yi^, and if D = yl^ then we call / a total 
function. 

A partial function <f ■. A* A* is said to be partial recursive if and only 
if there exists a Turing machine M such that cj) is computed by M, i.e., for 
all X € yi*, M halts if and only if x € dom((/)), in that case, M outputs 4>{x). 

A partial function 4> : A^ A\ is partial recursive if there exists a 
partial recursive function if : Al^^ A\ such that (f = Iz+^A* ° Ia*->-e+ ° V'- 

A partial recursive prefix function 4> : A^ A 2 is a partial recursive 
function such that dom(^) is prefix-free. 

Let (j) : {0,1}* yl* be a partial recursive prefix function. For all 
X G yi*, the complexity of x with respect to cf is dehned by 

jmm{l{p) :p€(j)-^{x)}, ((/)-i(x) / 0), 

\oo ( 4 .-^.) = 0). 

A partial recursive prehx function (/) : {0,1}* ^ A* is said to be additively 
optimal if for all partial recursive prefix function if : {0,1}* A*, there 
exists a constant G M such that 

VxGA*, Ar^(x) < iL^(x)-h 

Theorem 2.19 There exists an additively optimal partial recursive prefix 
function. 

Proof. See [1]. □ 

For each pair ((f, if) of additively optimal partial recursive prefix func¬ 
tions from {0,1}* to A*, there exists a constant > 0 such that for all 
X G A , |Ar0(x) Ar^(x)| ^ 

It is easily seen that any additively optimal partial recursive prefix func¬ 
tion is surjective. 

Definition 2.20 We fix one additively optimal partial recursive prefix func¬ 
tion (f : {0,1}* ^ A*. IFe define the prefix Kolmogorov complexity o/x G A* 
by 

K{x) := K^{x). 
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2.3 Shift dynamical system 

Let S be a nonempty finite set, and we set := By Tychonoff’s 

theorem, endowed with the product topology of the discrete topology on 
S is a compact topological space. It is well-known that this topology is also 
generated by the metric d{uj,uj') = where n{u},u}') = sup{n G N : 

\/g G An,ujg = oj'g] for all uj = {ujg)g^G-,^' = (Wg)geG € For all n G N and 
for all s G we define the cylinder set of s by |s] := {w G fl : w f A„ = s} 
where uj \ An denotes the restriction of cj to A„. Note that |s] is a clopen 
set. For all n G N, let Qn be the family of cylinder sets on i.e., 

:= {|sl : s G 


and set C := |J^ C^. The set C generates the Borel fi-algebra 55(11). 

We set 

OO 

:= IJ 

n=0 

where := {A} and for all n G N, := {{uJg)g^An ■ ^9 ^ ^n,^g G LI}, 
and write |B] := UsevI®! V C S^*. 

Let (T® : n ^ n denote the shift by <7 G G, i.e., {cr^uj)i := uJi+g for all 
UJ = {ujg)g^G-, and we write a := {a^)g^G- Then cr is a continuous action of 
G on n. Hence is a t.d.s.. Note that u is a map from G x H to H, 

i.e., cr : G X H 9 (< 7 , w) i-7> < 7 ^( 0 ;) G H. 

A nonempty subset 5* C H is called a subshift if and only if S is shift- 
invariant (i.e. Vg G G,cr^{S) = S) and S is closed. If 5 C H is a subshift, 
then (S', fj ( (G x S)) is a t.d.s.. There exists a measure of maximal entropy 
measure for cr ( (G x S) (see [3]). 

We call / : G ^ Z+ a computable function if there exists a partial 
recursive prefix function cf : {0,1}* —?> {0,1}* such that for all (xi, • • • , x^) G 

G, 


/(xi,--- ,Xrf) — (L{o,l}*^Z+o</') (-^tt-r{0,l}*(3^l) ■ ■ ■ 


where 



G = Z'^, 

G = Z$. 


We fix an arbitrary bijective computable function / : G —)• Z_|_ such that 
for all n G N, 


/(A„) = {0,1,-- - ,|A„|-1} 
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and define S : —)■ S* as follows. 


■ ■ ■ 'S/-1(|A„|-1)> s - (sg)gGAn G (n G N), 
] A, s = A. 

We define the prefix Kolmogorov complexity of s G by 

K(s) := K{S{s)). 

Lemma 2.21 For a// n G N and k G M>o, we define 

Dr,,k ■■= {s G : K(s) < k}. 


Then 

\Dn,k\ < 2 ^=+^ 

Proof. Note that for all s G (n G N), K(s) = K^{S{s)) oo . We define 
fi : —7> {0,1}* such that the following condition holds. 

fi{.s) = ps fiiPs) = S(s) and K(s) = l{ps). 

For all Sjt G we have 

sfit^ (fiPs) 4>{pt) ^Psfipt 

then fi is injective. Therefore 

\Dn,k\ = |{s G S"'-" : dps G {0, l}*,V’(s) < A:}| 

< \{p€{0,l}* :l{p) <k}\ 

< 1 + 2H-h - 1 < 2^+^ 


□ 


Definition 2.22 (Kolmogorov complexity density) The upper and lower 
Kolmogorov complexity density of uj G Q are defined by 

K(a; \ An) 


npf ^ r f -^n 

Jv(a;j := iimsup-j——j— 

n—>-cxD l-^^nl 


Kfuj) := liminf ■ 

n—>-oo 


|A. 


If %{lj) =%{!w), we simply denote them by i.e., 

K(w r An) 


%{uj) := lim 

n—>-oo 


|A. 


Remark 2.23 The quantities 3<C(a;) and%{u:) are independent of the choice 
of additively optimal partial recursive prefix function and S and uniquely 
defined. 
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3 Relation between KS entropy and Kolmogorov 
complexity 

Let d G N, G = or G = Z^, S be a nonempty finite set, and S C 
0 (:= be a subshift. Other notations are the same as before. We set 
? := (T f (G X S). Note that (5,?) is a t.d.s. We now state the main result. 

Theorem 3.1 (Brudno’s theorem for Z'^ (or subshifts) If fJ- € EM{S,<^), 
then 

lK(a;) = n-a.e.u) G S. (3-1) 


Remark 3.2 Brudno’s original result is on the case G = Z_|_ only m- In 
the case G = or G = U\_, Simpson showed that if pL is a measure of 
maximal entropy, then ^3.1\) holds E- Our theorem is a generalization of 
them. 


We prove Theorem 13.11 bv giving two lemmas. 


Lemma 3.3 If fJ, €: EM{S,g), then 

3C(a;) > h,;{p), fj-a.e.uj G S. (3-2) 


Proof. If h.;{p) = 0, then (|3.2p is obvious. 

Let h^{p) > 0 and fix an arbitrary /c G N such that ^ < h^{pL). For all 
n G N, we set 


L'n,fe:-{sGS^- ^|. 

By Lemma 12.211 we have 

We fix an arbitrary e G (O, and set 

Tn,k,e ■■= {s G : ptilsj nS) < . 

By Shannon-McMillan-Breiman theorem iTheorem 12.91) . the following holds 
for fi-a.e. uj € S 


3N^yn>N^, 


hdh) - 


-iog2Ai([‘^ t n S) 


\An 
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Note that 


/i^(Ai) - 


-log 2 ^(|w t A„] n S) 


|A. 




-log 2 ^(|w t AJ n S’) ^ ^ ^ ^ 1 

|A„| k 

2-|A„|(h,(M)-i+.) > ^ ^ 

UJ \ An, G Tn^k,e 

^ £ [7)i,A:,el n S. 


Hence we have for fi-a.e. oj & S 

3N^,yn >N^,ue lTn,k,e} n 5. (3.4) 

On the other hand, by ()3.3p and the definition of Tn^k,e: we have 


/ 


KlDn,k}nlTn,k,e}nS) = 


\ 


Hence 


JJ 1^1 n 5 

\s£D„i.nT„^k,e j 

^ ^-^ri, fe , fc, e 


5^MPn,fcln[rn,fc,,ln5) <cx). 

n=\ 


Therefore, by the Borel-Cantelli lemma, for //-a.e. a; € S', 

3^:, G N, Vn > A^:,a; ^ [^^1 O [rn,fc,,l O 
By (|3.4I1 and (13.5D . for fi-a.e. a; G 5, we have 

3iV'' G N,Vn > N^,cv i {D^^^^kl 

Since a; ^ |T>n,fc] means > ^f(A*) “ foi' fe G N, we have 


2C(a;) > hri^) — —, fi-a.e.uj G S'. 
k 


Thus (|3.2p holds. 


(3.5) 

(3.6) 

(3.7) 

□ 


+ e 
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Lemma 3.4 If ^ EM{S,<,), then 


3C(a;) < n-a.e.oj G S. (3-8) 

Proof. Fix an arbitrary m G N and let be the side length of the hypercube 
i.e., 


I'm ■ — 


m if G = 

2m — 1 if G = 


For each n G N>m, let us consider a covering of A„ by shifted A^- In 
particular, there uniquely exists A: G N such that 

m9 + A 

m ) C A„ C U m9 + A 

m) ? 

where Lmg + A^ := {Lmg + /i : /i G A^} and |J denotes disjoint union. We 
set A„ := UgGAfc+ ^ Let us consider bijective map 

r : {1, • • • , |S^’"|} and let rj := r{j) {1 < j < M). For an arbitrary 

cu G S', we define 

frj(w) := |{5 G Afc : G |rj] fl S}\, 

By definition, f^Aa^) + ■" + Ir-M(^) = l^fcl holds for all cu G S'. Since for 
all s G and for all u!i,u!2 G |s] n S, we have = frj{^2)- We set 

frj('S) := fr^ (w) {u G |s] n S). We endow with an equivalence relation 
as follows: 

Vsi,S2 G SW, Si S2 4 ^ fr(si) = fr(s2)- 

For s G let [s]f^ := {t G : g ~f^ t} be an equivalence class of s by 
Then we have 


I Mb I = 


fri(s)!fr2(s)!---A^(s)!' 


By the above mentioned preparations, we take the following procedures: 

(1) We fix a bijective map T from SW/ to := {(xi,--- ,xm) G 
: xi + • • • + xm = l^fcl} such that 

^ : [s]f, ^ (fn(s),-- - JrMis)), 


and identify with Vj^ 
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(2) We fix the arbitrary bijective maps and such that for 

each [s]f^ G ~f^, 

{1; ■ ■ ■ ) |[s]f^|} 

and 

Then we can uniquely identify each t G with {x.,y,z) where x G , 
y G [N'gr-i(x)(3'~^(x)) and z G {1,2,--- Hence there exists a 

partial recursive prefix function (p : {0,1}* —?> T,* such that 

Vo; G 5, 3x = (xi, • • • , xm) € , 3y G X^-i(,)(3-i(x)), G {1, 2, • • • , |}, 

4> (^lz+^{0,l}*{xi) ■ ■ ■ Iz+^{0,l}*ixM) lz+^{0,l}*{y) -fz+-)-{0,l}*(^)) = S(w t An) 

Obviously, Xj = frji^) (j € {!)••• > Af}). By the definition of K^, we have 

K^{^{uj \ An)) < I (^lz+^{0,l}*ixi) ■ ■ ■ Iz+^{0,l}*ixM) Iz+^{o,i}* Iz+^{o,i} 

( M 

Kh+^{0,1}* (xj)) + l{Iz+^{0,i}* (^)) 

+M + 1 + l{Iz+^{o,i}*{y))- 
The following inequalities can be easily seen: 

M M 

y^/(/z+^{o,i}*(xj)) < y^log2(xj + 1) < MlogadAfcl + 1), 
i=i i=i 

lih+M0,iri^)) < log2(|S^"\^1 + 1) < (|An| - |An|)log 2 |S| + 1, 

|Afc|! 


(3.9) 


>{0,1}* (y)) < iog2 y +1 < iog2 


By these inequalities and (j3.9n . we have 


xi! • • - xm! 


+ 1 . 


K^iSiio \ An)) 
|An| 


/ 1 , |Afc|! , 2 (|An|-|An|), ^ , 

<—log 2 -j- tH -r—--log 2 |S|+o(l), (n^-oo). 


|A„ 


Xi! • --xm'- 


\Ar 


(3.10) 

Let us estimate the right hand side of (|3.10p . By direct computations using 
Stirling’s formula, we can see that 


|A 


1 , |Afc|! 

log2 


xi!---xm! 


|Afc| 

|A. 


M 

E 

i=i 




|Afc| 


+ o(l), (n —>■ oo). (3.11) 
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Since Xj = frj (w) and ^ G EM{S,‘;), for fi-a.e.uj € S, we have the following. 

^ ^ S ^ '^}l 

fc—>-oo |iV/-| /c—>-oo |iV/-| 

" i™ ^ X] llr',lns(?“'^’"^a;) = /x(|rjl n 5). (3.12) 
I geAk 

The last equality is derived from the Birkhoff’s ergodic theorem. 

By An-L^ C A„ C and |A„| = |Am| • |Aa:|, we have |A„_l^| < 
I Am I • |Afc| < |A„|. Then 


and we have 


I An—L 


m 


|An 


1 _ \^n-Lm\ ^ |Afc| ^ 1 

I Am I I An I I An I |Am 


(2n-l)'i 


if G 
if G 



(n —>■ oo). 


Hence the following hold: 


lim 

n—^oo 


|Afc| 
I An I 


1 

I Am 


lim 

n—>-CO 



= 1 . 


(3.13) 


Obviously, if n —?> oo, then k ^ oo. By (I3.10p . (13.111) . (|3.12p . (I3.13P and 
Kolmogorov complexity’s definition, for /x-a.e.ca G S and for all m G N, we 
have 


lK(a;) < lim sup 

n^oo 


K^{9{u; (An)) 


|A, 


< lim sup 


|Afc| 

|A, 


M 

i=i 


X 


|Afc| 


^^ + 2(|An| lAnD iog^i^i 


|A, 


1 ^ 

h'-ml 


Hence we have the following inequality: 


M 


%{u)) < lim inf —;—- ip{^{lrj\ fl S)), for ^-a.e. uj & S. (3.14) 

m.—^no _ I ‘ ^ 


j = l 
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Note that a := {|a; \ Ai] D S}i^^s is a /^-generator and 
aA-= y ,-9a = {lrjjnS}fL,. 

Therefore, by Kolmogorov-Sinai theorem, we have the following equation. 

1 ^ 1 

(3-15) 

m-^oo Am ^^ m—>-oo Am 

j=l 

(j3.14p and (I3.15P complete the proof. □ 

Theorem 13.11 follows from Lemma 13.31 and Lemma 13.41 

Example 3.5 (d-dimensional Bernoulli shifts) Let{Q,a) be the d-dimensional 
shift space as before. We fix a probability vector q = {qi : i £ Ti) on T, and 
denote the corresponding Bernoulli measure on *B(f2) by /i := q^^. Then, 
by Kolmogorov-Sinai theorem, we can show that h(j{p) = Ylie'sTiQi)- By 
Theorem ld.il we have for pi-a.e. uj £ Q 

= '^T{Qi)- 
ies 

4 Representation of the pressure by using Kol¬ 
mogorov complexity density 

Let us consider some applications of Theorem 13.11 Notations are the same 
as in Section 3. 

Theorem 4.1 If pi £ M{S,(,), then we have 

hfih) = = lim K(s)/i([s] n 5). (4.1) 

Proof. Let pi = vdp{v) be the ergodic decomposition. By Theorem 

Eni Jacobs’s theorem (Theorem I2.18P and the main theorem (Theorem 
EH), we have 

I X{uj)dfi{uj) = I I f 'X{uj)du{uj)\ dp{u) = f hfii')dp{v) = hfip). 

Js JEMiSs) Us } JEMiSg) 
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On the other hand, by Lebesgue’s convergence theorem, we have 


lim 

n—>-oo 



E 

SSA.n 


K(s)/i(|s] n5) 




K(a; r A„) 

|An| 

K(a; r A„) 

|An| 






JC{uj)dfi{uj). 


□ 


Remark 4.2 In the case G = Z_|_, Theorem \4-I] can be found in m- 
Theorem 14.11 immediately leads one to the following theorem. 

Theorem 4.3 (Variational principle) Let V’ € USC{S), inf > —oo. 

Then the pressure of is given by 

piip) = sup fiiX + if). 

In particular, the topological entropy is sup^gjy ^(5 ,-)/i(3<C). If fa G is 

an equilibrium state for tp, then we have 

p{p) = fi{% + p). 

Theorem 14.31 shows that, in an equilibrium state, the pressure means the 
expectation value of the sum of Kolmogorov complexity density and local 
energy. For example, this theorem is directly applicable to the d-dimensional 
Ising model. 


Acknowledgments 

We are grateful to A. Aral for reading our paper and for his valuable com¬ 
ments. We also thank K. Tadaki for his important comments about how we 
should define the prefix Kolmogorov complexity of s G . We would also 
like to express our sincere gratitude to M. Yuri for her valuable comments 
and longstanding encouragements. T. Fuda would like to thank S. Galatolo 
and A. Sakai for valuable discussions. 


18 




References 


[1] V. Benci, C. Bonanno, S. Galatolo, G. Menconi, M. Virgilio, Dynamical 
systems and computable information. Discrete Gontin. Dyn. Syst. Ser. 
B 4, 935-960 (2004) 

[2] A. A. Brudno, Entropy and the complexity of the trajectories of a 
dynamical system. Trans. Mosc. Math. Soc. 2, 127-151 (1983) 

[3] G. Keller, Equilibrium States in Ergodic Theory. Gambridge University 
Press (1998) 

[4] M. Li, P. Vitanyi, An Introduction to Kolmogorov Gomplexity and Its 
Applications, 3rd edn. Springer (2008) 

[5] D. Ornstein, B. Weiss, The Shannon-McMillan-Breiman theorem for a 
class of amenable groups. Israel J. Math. 44, 53-60 (1983) 

[6] M. Pollicott, M. Yuri, Dynamical Systems and Ergodic Theory. Cam¬ 
bridge University Press (1998) 

[7] S. G. Simpson, Symbolic Dynamics; Entropy = Dimension = Complex¬ 
ity. Theory Comput. Syst. 56, 527-543 (2015) 

[8] P. Walters, An Introduction to Ergodic Theory. Springer (1982) 


19 



